Eyewear frame customization using machine learning

ABSTRACT

A design system generates a design for an eyewear frame customized for a user. The eyewear frame provides audio content to the user. The design system captures anthropometric data of the user. Using machine learning techniques, the design system determines features of the user from the anthropometric data and generates a three dimensional (3D) geometry of the portion of the user&#39;s head. A design for the customized eyewear frame is generated based on the 3D geometry of the portion of the user&#39;s head. The design of the customized eyewear frame includes design parameters that describe a shape of a coupling element that ensures the eyewear frame is customized to the user&#39;s head.

FIELD OF THE INVENTION

This disclosure generally relates to using machine learning to generatethree dimensional (3D) geometries, and specifically relates to eyewearframe customization based on a 3D geometry of a user's head.

BACKGROUND

Headsets present users with audio and visual content. A standard shapeand size of a headset may not fit for all users, due to variations inthe shape and geometry of heads and ears of users. The ill-fittingheadset may feel uncomfortable to a user and/or result in a degradedquality of audio and visual content presented to the user.

SUMMARY

Machine learning techniques may be used to customize an eyewear framefor a user. From anthropometric data (e.g., images of a user's head) ofthe user, machine learning techniques identify features of the user, andsubsequently generate a three-dimensional (3D) geometry of at least aportion of the user's head. The 3D geometry of the head specifiesfeatures that may be unique to the user, such as a distance from an eyeof the user to an ear of the user. Accordingly, from the 3D geometry, adesign for an eyewear frame is customized for the user.

A method generates a design of a frame for customized eyewear. Themethod includes generating a 3D geometry of a portion of a head of auser based in part on anthropometric data. The method includesdetermining design parameters for a coupling element based in part onthe 3D geometry describing the portion of the user's head, wherein thecoupling element includes a customized end of a temple including atemple tip. A shape of the coupling element is based in part on thedesign parameters, wherein the coupling element interfaces with theeyewear frame. The eyewear frame is customized to the user's head.

In some embodiments, a system generates a design of a frame forcustomized eyewear. The system includes an imaging device configured tocapture an image and a controller. The controller is configured togenerate a 3D geometry of a portion of a user's head based in part onanthropometric data from the image. The controller is further configuredto determine design parameters for a coupling element based in part onthe 3D geometry of the portion of the user's head, the coupling elementincluding a customized end of a temple. The temple includes a templetip. A shape of the coupling element is based in part on the determineddesign parameters, wherein the coupling element interfaces with eyewearframe. The eyewear frame is customized to the user's head.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an imaging device capturing an image of a user, inaccordance with one or more embodiments.

FIG. 2 shows a system environment including a design system, inaccordance with one or more embodiments.

FIG. 3A shows a view of an ear of the user, in accordance with one ormore embodiments.

FIG. 3B shows a cross-sectional view of an ear including an in-eardevice, in accordance with one or more embodiments.

FIG. 4A shows an eyewear frame including coupling elements, inaccordance with one or more embodiments.

FIGS. 4B and 4C show a portion of the eyewear frame of 4A, in accordancewith one or more embodiments.

FIG. 4D shows a top-down view of a user wearing the eyewear frame of 4A,in accordance with one or more embodiments.

FIG. 5 is a process for generating a design of a customized in-eardevice, in accordance with one or more embodiments.

FIG. 6 is a process for generating a design of a customized eyewearframe, in accordance with one or more embodiments.

The figures depict various embodiments for purposes of illustrationonly. One skilled in the art will readily recognize from the followingdiscussion that alternative embodiments of the structures and methodsillustrated herein may be employed without departing from the principlesdescribed herein.

DETAILED DESCRIPTION

A design system generates designs of devices customized for a user. Thedevices may include an in-ear device and/or an eyewear frame, bothconfigured to present audio content to the user. Conventional in-eardevices and eyewear frames are often available for users in standardsizes for small, medium, and large sized ears and heads, respectively.However, users' features vary greatly even between these standard sizes,which conventional in-ear devices and eyewear frames do not account for.Accordingly, to accommodate variations in size and/or shape of a user'sear and/or head, the design system described herein generates designs ofdevices customized for the user.

Based on a user's anthropometric data (e.g., images of the user's ear),the design system generates designs for the customized in-ear deviceand/or eyewear frame. The in-ear device is customized to fit within atleast a portion of an ear canal of the user, sealing against the earcanal and/or a portion of a conchal bowl, to better preserve the qualityof audio presented via the in-ear device. The eyewear frame iscustomized to fit the user's head. The frame includes an arm with acoupling element, wherein the coupling element can rotate towards theuser's head and/or ears. Accordingly, the customized eyewear frame mayfit well on the user's head, ensuring a better audio experience.

The design system generates the customized designs usingthree-dimensional (3D) geometries of at least portions of the user'shead and/or ear that are obtained using a machine learning algorithmthat is trained on a plurality of anthropometric data of other users.After receiving anthropometric data of the user, the trained machinelearning algorithm generates the 3D geometries of the user's ear and/orthe portion of the user's head. The 3D geometries are used to determinedesign parameters for the in-ear device and/or the eyewear frame. Insome embodiments, the in-ear device and/or the eyewear frame may bemanufactured from the design parameters and provided to the user. Insome embodiments, the in-ear device 360 may comprise two components: acustomized shell and a non-custom transducer assembly (i.e. an assemblyincluding acoustic sensors, audio controller, speaker, PCB board,housing and corresponding circuitries), where the customized shell isdesigned based on the 3D geometry obtained from the trained ML pipeline.

Embodiments of the invention may include or be implemented inconjunction with an artificial reality system. Artificial reality is aform of reality that has been adjusted in some manner beforepresentation to a user, which may include, e.g., a virtual reality (VR),an augmented reality (AR), a mixed reality (MR), a hybrid reality, orsome combination and/or derivatives thereof. Artificial reality contentmay include completely generated content or generated content combinedwith captured (e.g., real-world) content. The artificial reality contentmay include video, audio, haptic feedback, or some combination thereof,and any of which may be presented in a single channel or in multiplechannels (such as stereo video that produces a three-dimensional effectto the viewer). Additionally, in some embodiments, artificial realitymay also be associated with applications, products, accessories,services, or some combination thereof, that are used to, e.g., createcontent in an artificial reality and/or are otherwise used in (e.g.,perform activities in) an artificial reality. The artificial realitysystem that provides the artificial reality content may be implementedon various platforms, including an HMD connected to a host computersystem, a standalone HMD, a mobile device or computing system, or anyother hardware platform capable of providing artificial reality contentto one or more viewers.

FIG. 1 shows an imaging device 110 capturing one or more images of auser 120, in accordance with one or more embodiments. The imaging device110 captures one or more images of the user 120, the one or more imagesincluding at least a portion of the head 130 (e.g., an ear 140). In someembodiments, the one or more images may be part of a video captured bythe imaging device 110. Some or all of the one or more images may be offportions of the head 130 from different angles and/or distances relativeto the user 120. The imaging device 110 is a camera, and may be coupledto a device (e.g., a cellphone of the user 120) that is communicativelycoupled to a design system. In another embodiment, the imaging device110 is a component of a headset of the user 120. And in someembodiments, the imaging device 110 is a standalone imaging device,separate from the device. In some embodiments, the imaging device 110 isa depth camera assembly (DCA) that captures depth information about theuser 120's head 130 and/or ear 140. In some embodiments, the imagingdevice 110 is a time of flight camera. For example, the user 120 maytake images of themselves from a front facing imaging device 110 oftheir device. In some embodiments, another user may take the one or moreimages of the user 120.

Anthropometric data is provided by the device to the design system.Anthropometric data describes a shape of some or all of the head 130.Anthropometric data may include, e.g., one or more images and/or videoof the head 130 (e.g., taken by the imaging device 110 or some otherimaging device), one or more images and/or video of one or both ears ofthe user 120 (e.g., taken by the imaging device 110 or some otherimaging device), measurements of the head 130, some other datadescribing a shape of some or all of the head 130, or some combinationthereof. For example, an imaging device may be communicatively coupledto the design system. An imaging device may capture the anthropometricdata of the user, such as one or more images of the user 120 and providethe data to the design system. The design system subsequently identifiesfeatures of the user from the anthropometric data and generates designsof an in-ear device and/or an eyewear frame using the receivedanthropometric data. The design system generates a 3D geometry of someor all of the head 130 and/or each ear of the user (e.g., the ear 140).And as described below with reference to FIGS. 2 to 6 based on the 3Dgeometries, customized designs for an in-ear device and/or an eyewearframe are generated for the user 120.

FIG. 2 shows a system environment 200 including a design system 210, inaccordance with one or more embodiments. The system environment 200includes the design system 210, one or more devices 220, and amanufacturing system 230. In some embodiments, the design system 210 iscommunicatively coupled via a network 240 to the one or more devices220. In some embodiments, the design system 210 is also coupled via thenetwork 240 to the manufacturing system 230. In some embodiments, thesystem environment 200 includes additional components and/or othercomponents than those described herein.

The one or more devices 220 communicate with the design system 210. Eachof the one or more devices 220 are associated with at least one user. Adevice 220 provides anthropometric data describing a shape of a portionof a target user's head. In some cases, the target user may be the userassociated with the device 220. The device 220 may be, e.g., a mobilephone, a laptop, a tablet, a headset (e.g., near-eye display, ahead-mounted display), or some other computing device that iscommunicatively coupled to the design system 210. In some embodiments,one or more of the devices 220 may include an imaging device 110. Insome embodiments, the one or more devices 220 may capture theanthropometric data and/or receive the anthropometric data captured byother devices.

The manufacturing system 230 produces the customized in-ear deviceand/or the customized eyewear frame for the user (e.g., the user 120).In some embodiments, the manufacturing system 230 receives the designsfrom the design system 210 over the network 240. In some embodiments,the manufacturing system 230 is a part of the design system 210. Themanufacturing system 290 is a system that can fabricate an in-ear deviceand/or a customized eyewear frame. In some embodiments, themanufacturing system 290 may be, e.g., a three-dimensional (3D) printer,an injection molding system, a computer controlled system, some othersystem that can fabricate an in-ear device and/or a customized eyewearframe, or some combination thereof.

The network 240 couples the design system 210 to the one or more devices220 and/or to the manufacturing system 230. The network 240 may includeany combination of local area and/or wide area networks using bothwireless and/or wired communication systems. For example, the network240 may include the Internet, as well as mobile telephone networks. Inone embodiment, the network 240 uses standard communication technologiesand/or protocols. Hence, the network 240 may include links usingtechnologies such as Ethernet, 802.11, worldwide interoperability formicrowave access (WiMAX), 2G/3G/4G mobile communications protocols,digital subscriber line (DSL), asynchronous transfer mode (ATM),InfiniBand, PCI Express Advanced Switching, etc. Similarly, thenetworking protocols used on the network 240 can include multiprotocollabel switching (MPLS), the transmission control protocol/Internetprotocol (TCP/IP), the User Datagram Protocol (UDP), the hypertexttransport protocol (HTTP), the simple mail transfer protocol (SMTP), thefile transfer protocol (FTP), etc. The data exchanged over the network240 can be represented using technologies and/or formats including imagedata in binary form (e.g. Portable Network Graphics (PNG)), hypertextmarkup language (HTML), extensible markup language (XML), etc. Inaddition, all or some of links can be encrypted using conventionalencryption technologies such as secure sockets layer (SSL), transportlayer security (TLS), virtual private networks (VPNs), Internet Protocolsecurity (IPsec), etc.

The design system 210 outputs designs of devices customized for theuser. The customized designs include a customized in-ear device and/or acustomized eyewear frame. The design system 210 includes a detectionmodule 250, a geometry generation module 260, a customized design module270, a data store 280. In alternate embodiments, the design system 210may also include the manufacturing system 230. In some embodiments, thedesign system 210 may be a component of and/or hosted on one or more ofthe devices 220 In some embodiments, the design system 210 includesmodules other than those shown in FIG. 2. Similarly, in some cases,functions can be distributed among the components in a different mannerthan is described here.

The detection module 250 detects features of the user (e.g., the user120) from anthropometric data. The detection module 250 may use machinelearning algorithms, edge detection, and/or computer vision to detectfeatures of the user, the features relating to a face and/or a head ofthe user. For example, the features may be parts of an ear (e.g., theear 140) and/or a portion of a head (e.g., the head 130).

In some embodiments, the detection module 250 identifies a location ofone or more features of the user via image processing and imagesegmentation. The detection module 250 may use a Canny edge detectionalgorithm to identify a location of the ear and/or portion of the head.In another embodiment, the detection module 250 may use cascadedAdaBoost classifiers and algorithms to detect and localize an ear withinthe input images.

In some embodiments, the detection module 250 trains one or more machinelearning algorithms to detect features from anthropometric data. Thetraining includes a positive training set and a negative training set.The positive training set includes a plurality of anthropometric data ofother users with known features. For example, the plurality ofanthropometric data in the positive training set may include a pluralityof images of other users, each image including at least one feature in aknown location. The negative training dataset includes a plurality ofimages that do not include known user features.

The detection module 250 applies the trained machine learning algorithmto the user's anthropometric data. In response to receivinganthropometric data of the user, such as one or more images of the user,the machine learning algorithm outputs features of the user. Features ofthe user describe anatomical characteristics of the user. For example,features of the user may include an ear, a nose, an eyebrow, some otheranatomical characteristics, or some combination thereof. The outputfeatures may include measurements as well as locations within theanthropometric data of the identified features. For example, theidentified features may be of an ear of the user, such as an entrance toan ear canal, a conchal bowl of the ear, and a pinna, among others. Insome embodiments, the identified features of the user may also includefeatures of a portion of the user's head, such as a distance from an eyeto the pinna, a temple, and a diameter and/or length of the ear. Themachine learning technique used may be a cascaded adaptive boosting(AdaBoost) algorithm. Other examples of machine learning techniquesinclude linear support vector machine (linear SVM), neural networks,logistic regression, naïve Bayes, memory-based learning, random forests,bagged trees, decision trees, boosted trees, or boosted stumps, whichmay be used in different embodiments.

In some embodiments, the detection module 250 uses computer visiontechniques to detect features of the user. The computer visiontechniques enable the detection module 250 to detect features of theuser from a plurality of anthropometric data (e.g., a plurality ofimages). The plurality of images may be from different angles, in whichsome features of the user may be occluded (e.g., hair covering an ear ofthe user in some angles). Accordingly, the detection module 250 detectsfeatures of the user from images showing the user from multiple angles,even when the features are occluded in a subset of the images.

The geometry generation module 260 generates a three-dimensional (3D)model of the features of the user from anthropometric data. The 3D modelincludes features such as the ear of the user and/or a portion of theuser head. The geometry generation module 260 may annotate theanthropometric data, such as the one or more images of the user. Theannotations may locate and/or describe the features identified by thedetection module 250. For example, annotations of an ear of the user mayinclude features of the ear, such as a pinna, an entrance to an earcanal, and/or a conchal bowl of the ear. Annotations of features mayfurther include measurements of the user's ear relative to the user'shead, including a distance from the ear to an eye of the user, a lengthof the ear, and a width of the ear. The length of the ear may bemeasured from the top surface of the pinna to the ear lobe, whereas thewidth of the ear may be measured from the side of the pinna to a tragusof the ear. The annotations may include features of the user other thanthose described herein.

The geometry generation module 260 uses machine learning techniques,such as a convolutional neural network, to generate a 3D geometry (i.e.,mesh) of the identified features of the user. In particular, thegeometry generation module 230 generates a 3D geometry of the user'sear, as well as a 3D geometry of the portion of the user's head. Themesh comprises key points and edges of the identified features based onthe annotated anthropometric data. The geometry generation module 260 istrained on a positive training set and a negative training set. Thepositive training set includes other users' anthropometric datacorresponding to previously generated meshes, such as images of theirheads and ears with corresponding 3D geometries. Accordingly,anthropometric data of a user's ear, for example, may correspond to amesh of a user's ear that delineates a 3D geometry of an ear canal ofthe user's ear. The negative training set includes anthropometric datafor other users that do not include the heads and ears of other users.Accordingly, in response to anthropometric data, such as an image, ofthe user's ear and/or a portion of the user's head, the geometrygeneration module 260 outputs a set of key points and detected edges.The key points and detected edges are compiled to form a 3D geometry ofthe user features captured in the anthropometric data. In someembodiments, the geometry generation module 260 uses a decoder topredict key points that are occluded. For example, a portion of the earin the image used as input anthropometric data may be occluded by aportion of the user's ear, an earring, and/or a scarf. The geometrygeneration module 260 creates a shape basis from the detected key pointsand edges and subsequently generates a 3D reconstructed geometry of theear.

The customized design module 270 generates a design for devicescustomized for the user. The customized devices may include an in-eardevice and/or an eyewear frame, among others. The designs may be one ormore computer aided design and/or graphics documents describing theshapes and specifications of the customized devices.

In some embodiments, the customized design module 270 generates a designfor the in-ear device from a 3D geometry of the user ear. As notedabove, the generated 3D geometry of the user's ear includes a geometryof the ear canal. The customized design module 270 subsequentlygenerates the design for the in-ear device, the design describing ashell of the in-ear device that fits at least within a portion of theuser's ear canal. In some embodiments, the design of the shell isconfigured to seal against the user's ear canal, thereby preventing theleakage of audio content produced by the in-ear device. In someembodiments, the design specifies that a portion of the shell is alsoconfigured to rest and/or seal against the user's conchal bowl, when thein-ear device is placed within the ear canal. The shell is also designedto house components of the in-ear device, such as one or more acousticsensors, a controller, and a speaker. Some subset of the in-ear device'scomponents within the shell may be standardized across multiple users,whereas in some embodiments, the components are customizable by eachuser. The customized design module 270 provides, in some embodiments,the design of the in-ear device to the manufacturing system 230.

In some embodiments, the customized design module 270 generates a designfor an eyewear frame customized for the user. The eyewear frame producesaudio content for the user. The customized design module 270 determinesdesign parameters for a coupling element of the eyewear frame. Thecoupling element may include a temple and/or a temple tip, each of whichmay be customized for the user. In some embodiments, at least a portionof the coupling element may be fungible and/or customizable by and/orfor the user. For example, the design parameters may specify an angle ofrotation of the coupling element. The temple may accordingly shiftinwards, towards the user's head, to ensure a customized fit. In someembodiments, the angle of rotation also specifies a bend of the templetip around the user's ear, thereby preventing the eyewear frame fromfalling off.

The data store 280 stores data for use by the design system 210. Thedata stored in the data store 280 may include anthropometric data ofusers, features of users, designs of the in-ear device and/or eyewearframe, data sets for training the detection module 250 and the geometrygeneration module 260, the generated 3D geometries of the user, otherdata relevant for use by the design system 210, or some combinationthereof.

FIG. 3A shows the ear 140 of the user 120, in accordance with one ormore embodiments. Anthropometric data (e.g., images, measurements, etc.)describing the ear 140 are used by a design system to generate a designfor a customized in-ear device for the user 120. The ear 140 includesfeatures such as a pinna 310, an entrance to an ear canal 320, a tragus330, a conchal bowl 340, or some combination thereof. The ear 140includes features other than those described herein.

The imaging device 110, as described in FIG. 1, may capture theanthropometric data of the ear 140. A machine learning algorithm of thedesign system may identify features of the ear 140 from theanthropometric data. The machine learning algorithm generates a 3Dgeometry of the ear 140. The machine learning algorithm may be trainedon a plurality of anthropometric data of other users' ears.

FIG. 3B shows a cross-sectional view 350 of the ear 140 including anin-ear device 360, in accordance with one or more embodiments. Thein-ear device 360, customized to fit within the ear 140, presents audiocontent to a user (e.g., the user 120). The cross-sectional view 350includes the ear canal 320, the conchal bowl 340, an ear drum 345, andthe in-ear device 360. The in-ear device 360 presents audio content tothe user. A portion of the in-ear device 360 fits within a portion ofthe ear canal 320 and/or fits against a portion of the conchal bowl 340.The in-ear device 360 includes acoustic sensors 370A, 370B, a speaker380, a shell 390, and an audio controller 395. In some embodiments, thein-ear device 360 may be communicatively coupled to a headset and/orinclude additional components than those described herein.

The acoustic sensors 370A, 370B monitor and detect sound. The acousticsensor 370A may detect sound from a local area around the user 120 andsound transmitted via tissue conduction. For example, in addition to thein-ear device 360, the user 120 may be wearing a headset with an audiosystem that provides audio content via tissue conduction. Accordingly,the acoustic sensor 370A may detect acoustic content generated byvibrations to tissue in and/or around the ear 140 of the user 120. Theacoustic sensor 370B may detect sound from the local area. In someembodiments, the acoustic sensor 370B couples to the shell 390, suchthat it is unoccluded and detects sound from the local area around theuser 120. The acoustic sensors 370A, 370B may be microphones and/oraccelerometers, for example. The acoustic sensors 370A, 370B transmitacoustic data to the audio controller 395.

The speaker 380 presents audio content to the user 120 as perinstructions from the audio controller 395. In some embodiments, thespeaker 380 presents audio content via air conduction, wherein thespeaker 380 creates and transmits airborne acoustic pressure waves tothe ear drum 345. The ear drum 345's vibrations are detected as sound bya cochlea of the ear 140. In other embodiments, the speaker 380 presentsaudio content via tissue conduction, wherein vibrations of tissue inand/or around the ear pass through a middle ear ossicular chain of theear 140 to the cochlea.

The shell 390 houses the components of the in-ear device 360. The designof the shell 390, produced by the design system, is customized for theear 140 of the user 120. The shell 390 is configured to seal against theear canal 320. As seen in FIG. 3B, a portion of the shell 390 extends toand seals against a portion of the conchal bowl 340 of the ear 140 aswell. In some embodiments, the shell 390 is customized to one or both ofa portion of the user 120's ear canal 320 and a portion of the user120's conchal bowl 340. Accordingly, the customized shell 390 reducesleakage of audio content presented by the speaker 380. To achievehear-through capabilities, the shell 390 provides appropriate passiveattenuation (i.e., attenuation of the sounds from the environment to theacoustic sensor 370A). The in-ear device 360 may also feel morecomfortable for the user 120. The design of the shell 390 may specifythat the shell 390 be composed of foam, silicone, plastic, rubber, orsome combination thereof. In some embodiments, the design systemprovides the design of the shell 390 to a manufacturer of the in-eardevice 360.

In some embodiments, a subset of the components within the shell 390 ofthe in-ear device 360 may each be customized for the user 120. Forexample, the in-ear device 360 for the user 120 may include two acousticsensors and one speaker within the in-ear device 360, while anotheruser's in-ear device may include one acoustic sensor and one speaker. Inanother embodiment, the components of in-ear device 360 may be standardacross a plurality of in-ear devices, such that all users' in-eardevices have substantially similar components.

The audio controller 395 receives and processes sound detected by theacoustic sensors 370A, 370B, and instructs the speaker 380 to play audiocontent. The audio controller 395 may instruct the speaker 380 to playaudio content based on sound detected by the acoustic sensors 370A,370B. For example, the audio controller 395 may amplify, attenuate,and/or augment sound from the local area. In some embodiments, the audiocontroller 395 couples to the headset of the user 120 and instructs thespeaker 380 to play audio content corresponding to visual contentpresented to the user 120.

FIG. 4A shows an eyewear frame 410 including coupling element 420 a and420 b, in accordance with one or more embodiments. The eyewear frame 410provides audio content, and in some embodiments, video content to theuser 120. In addition to the coupling elements 420 a and 410 b, theeyewear frame 410 includes temples 430 a and 430 b, temple tips 440 aand 440 b, and tissue transducers 450 a and 450 b. The eyewear frame 410may be customized to the user 120's head by a design system, based onanthropometric data of the user 120, as shown in FIG. 1. The eyewearframe 410 may include other features than those described herein, suchas a display element and/or corrective lenses.

A coupling element (e.g., 420 a) couples a temple (e.g., 430 a) to atemple tip (e.g., the temple tip 440 a). Each coupling element 420 a,420 b may be customized to fit the head 130 of the user 120 by rotatingtowards the head 130 and/or around user's ears (e.g., the ear 140). Thecoupling elements 420 a, 420 b may be customized for the head 130 of theuser 120 as per a 3D geometry of a portion of the head 130, output bythe design system. The machine learning algorithm generates a 3Dgeometry of the portion of the head 130. The design system, based on theoutput 3D geometry of the portion of the head 130, generates designparameters for one or both of the coupling elements 420 a, 420 b. Thedesign parameters may include a respective length for one or both of thecoupling elements 420 a, 420 b, a respective angle of rotation for oneor both of the coupling elements 420 a, 420 b towards the head 130,and/or a respective angle of rotation for one or both of the couplingelement 420 a, 420 b around the ear. The coupling element 420 a, 420 bmay include and/or couple to at least one of the temples 430 a, 430 band the temple tips 440 a, 440 b. The temples 430 a, 430 b each coupleto an arm of the eyewear frame 410. The temple tip 440 a secures theeyewear frame 410 around the ear 140 a of the user 120, for example.

The tissue transducers 450 a, 450 b are configured to present audiocontent to the user 120 via tissue and/or bone conduction. The tissuetransducers 450 a, 450 b may couple to the head 130 of the user, such astissue behind the ears (e.g., the ear 140), and directly vibrate boneand/or cartilage to generate the audio content. In some embodiments, thein-ear device 360 may additionally provide audio content to the user120.

FIGS. 4B and 4C show a portion of the eyewear frame of 4A, in accordancewith one or more embodiments. The coupling element 420 a may becustomized for the user 120 as per the design system's designparameters. The coupling element 420 a may couple to and/or include thetemple 430 a and the temple tip 440 a.

In FIG. 4B, the coupling element 420 a may rotate by a temple rotationangle β. The temple 430 a may be rotated towards the head 130 of theuser 120 as per the temple rotation angle β. The temple rotation angle βis a rotation about the y axis. In other embodiments, the temple 430 mayrotate about other axes as well. Accordingly, an arm of the eyewearframe may fit better against the head 130 of the user 120. The templerotation angle β may be included in the design parameters determined bythe design system. A plurality of users may have varying temple rotationangles β.

In FIG. 4C, the coupling element 420 a may bend by a tip bend angle θ.The temple tip 440 a may rotate as per the tip bend angle to curvearound the ear 140 of the user 120. Accordingly, the temple tip 440 asecures the eyewear frame to the head 130 of the user 120. The tip bendangle θ is a rotation about the z axis, but in other embodiments, mayrotate about other axes as well, in other embodiments. The tip bendangle θ may be included in the design parameters determined by thedesign system, and a plurality of users may have varying tip bend anglesθ.

Thus, the customized coupling element 420 a contributes to a custom fitof the eyewear frame 410 to the user 120.

FIG. 4D shows a top-down view 475 of a user wearing the eyewear frame of4A, in accordance with one or more embodiments. The top-down view 475includes the user 120, with the head 130, and the ear 140, wearing theeyewear frame 410. The eyewear frame 410, customized to the user 120,include the coupling elements 420, 420 b, the temples 430 a, 430 b, andthe temple tips 440 a, 440 b. The coupling element 420 a is rotatedtowards the head 130 of the user by the temple rotation angle β at theear 140 and the temple tip 440 a curves around the ear 140 by the tipbend angle θ (not pictured in FIG. 4D). The temple rotation angle β andthe tip bend angle θ may be inverted for the other ear of the user 120,such that when anthropometric data of both ears of the user 120 areunavailable, customization along the other coupling element 420 b may bereflected along a central axis of the head 130.

FIG. 5 is a process 500 for generating a design of a customized in-eardevice, in accordance with one or more embodiments. The process shown inFIG. 5 may be performed by components of a design system (e.g., thedesign system 210). Other entities may perform some or all of the stepsin FIG. 5 in other embodiments. Embodiments may include different and/oradditional steps, or perform the steps in different orders.

The design system processes 510 anthropometric data of a user (e.g., theuser 120). In some embodiments, the anthropometric data is one moreimages of the user. The images may be captured by a device, such as anartificial reality (AR)/virtual reality (VR) headset and/or a clientdevice, such as a mobile phone. In some embodiments, the anthropometricdata may be extracted from a captured video of the user. Theanthropometric data includes an ear of the user. The design systemdetects features of the user from the anthropometric data using machinelearning techniques and/or edge detection. For example, features of theear include a pinna, a conchal bowl, and an entrance to an ear canal ofthe user.

The design system generates 520 a 3D geometry of the user's ear. The 3Dgeometry is based on the detected features of the ear and is generatedby machine learning techniques such as convolutional neural networks.The machine learning model that generates the 3D geometry is trained ona plurality of images of other users' ears. The 3D geometry may describea portion of the user's ear canal.

The design system generates 530 a design of the in-ear device. Thedesign of the in-ear device includes a shell, wherein a portion of theshell is customized to fit within a portion of the user's ear canal. Thedesign system generates the design from the generated 3D geometry. Insome embodiments, the design of the in-ear device also includescircuitry configured to produce audio content. The circuitry isconfigured to fit within the shell and in some embodiments, may becustomized for and/or by the user.

FIG. 6 is a process 600 for generating a design of a customized eyewearframe, in accordance with one or more embodiments. The process shown inFIG. 6 may be performed by components of a design system (e.g., thedesign system 210). Other entities may perform some or all of the stepsin FIG. 6 in other embodiments. Embodiments may include different and/oradditional steps, or perform the steps in different orders.

The design system processes 610 anthropometric data of a user (e.g., theuser 120). As described in FIG. 6, anthropometric data may be one ormore images of the user, the images including at least a portion of theuser's head. In some embodiments, the one or more images are captured byan imaging device, such as an artificial reality (AR)/virtual reality(VR) headset and/or a client device, such as a mobile phone. In someembodiments, the captured anthropometric data may be extracted from acaptured video of the user. The design system locates features of theuser from the anthropometric data using machine learning techniquesand/or edge detection. For example, the design system may determine andlocate features such as a distance of the ear from an eye of the userand a size of the ear.

The design system generates 620 a 3D geometry of the features of theuser. The 3D geometry is generated by machine learning techniques suchas convolutional neural networks. The machine learning model thatgenerates the 3D geometry is trained on a plurality of images of otherusers' heads and ears.

The design system generates 630 design parameters for the customizedeyewear frame. The design parameters are customized to the user anddescribe a coupling element that interfaces with the eyewear. Thecoupling element includes a customized end of a temple that includes atemple tip.

The foregoing description of the embodiments of the disclosure has beenpresented for the purpose of illustration; it is not intended to beexhaustive or to limit the disclosure to the precise forms disclosed.Persons skilled in the relevant art can appreciate that manymodifications and variations are possible in light of the abovedisclosure.

Some portions of this description describe the embodiments of thedisclosure in terms of algorithms and symbolic representations ofoperations on information. These algorithmic descriptions andrepresentations are commonly used by those skilled in the dataprocessing arts to convey the substance of their work effectively toothers skilled in the art. These operations, while describedfunctionally, computationally, or logically, are understood to beimplemented by computer programs or equivalent electrical circuits,microcode, or the like. Furthermore, it has also proven convenient attimes, to refer to these arrangements of operations as modules, withoutloss of generality. The described operations and their associatedmodules may be embodied in software, firmware, hardware, or anycombinations thereof.

Any of the steps, operations, or processes described herein may beperformed or implemented with one or more hardware or software modules,alone or in combination with other devices. In one embodiment, asoftware module is implemented with a computer program productcomprising a computer-readable medium containing computer program code,which can be executed by a computer processor for performing any or allof the steps, operations, or processes described.

Embodiments of the disclosure may also relate to an apparatus forperforming the operations herein. This apparatus may be speciallyconstructed for the required purposes, and/or it may comprise ageneral-purpose computing device selectively activated or reconfiguredby a computer program stored in the computer. Such a computer programmay be stored in a non-transitory, tangible computer readable storagemedium, or any type of media suitable for storing electronicinstructions, which may be coupled to a computer system bus.Furthermore, any computing systems referred to in the specification mayinclude a single processor or may be architectures employing multipleprocessor designs for increased computing capability.

Embodiments of the disclosure may also relate to a product that isproduced by a computing process described herein. Such a product maycomprise information resulting from a computing process, where theinformation is stored on a non-transitory, tangible computer readablestorage medium and may include any embodiment of a computer programproduct or other data combination described herein.

Finally, the language used in the specification has been principallyselected for readability and instructional purposes, and it may not havebeen selected to delineate or circumscribe the inventive subject matter.It is therefore intended that the scope of the disclosure be limited notby this detailed description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosure of the embodimentsis intended to be illustrative, but not limiting, of the scope of thedisclosure, which is set forth in the following claims.

What is claimed is:
 1. A method comprising: generating athree-dimensional (3D) geometry of a portion of a head of a user basedin part on anthropometric data; and determining design parameters for acoupling element based in part on the 3D geometry of the portion of theuser's head, the coupling element configured to couple to a temple, thecoupling element including a customized end of the temple that includesa temple tip and a shape of the coupling element is based in part on thedesign parameters and the design parameters include a first rotation ofthe temple tip towards the user's head and a second rotation of thetemple tip around an ear of the user, wherein the second rotation isabout an axis that is substantially perpendicular to the couplingelement and extends from a location on the coupling element towards theuser's head, wherein the coupling element interfaces with an eyewearframe such that the frame is customized to the user's head.
 2. Themethod of claim 1, further comprising: detecting, from theanthropometric data, features of the user; and generating, based on thefeatures of the user, the 3D geometry of the portion of the user's head.3. The method of claim 2, wherein the features of the user include atleast one of a pinna of an ear of the user, a distance of the user's earfrom an eye of the user; and a size of the user's ear.
 4. The method ofclaim 1, wherein generating the 3D geometry of the portion of the user'shead comprises: determining features of the user using theanthropometric data; identifying key points and detected edgesdescribing the portion of the user's head using a machine learningalgorithm and the features; and compiling the key points and detectededges to form the 3D geometry of the portion of the user's head.
 5. Themethod of claim 1, wherein the design parameters include a length of thecoupling element.
 6. The method of claim 1, wherein the designparameters for the coupling element are provided to a manufacturer ofthe eyewear frame.
 7. The method of claim 1, wherein the anthropometricdata includes measurements of at least the portion of the user's head,and the measurements are used to generate the 3D geometry of the portionof the user's head.
 8. The method of claim 1, wherein the anthropometricdata is an image of the portion of the user's head received from adevice, and the image is used to generate the 3D geometry of the portionof the user's head.
 9. The method of claim 1, wherein the anthropometricdata is determined from a video of the user.
 10. A system comprising: animaging device configured to capture an image; and a controllerconfigured to: generate a three-dimensional (3D) geometry of a portionof a head of a user based in part on anthropometric data from the image;and determine design parameters for a coupling element based in part onthe 3D geometry of the portion of the user's head, the coupling elementconfigured to couple to a temple, the coupling element including acustomized end of the temple that includes a temple tip and a shape ofthe coupling element is based in part on the design parameters and thedesign parameters include a first rotation of the temple tip towards theuser's head and a second rotation of the temple tip around an ear of theuser, wherein the second rotation is about an axis that is substantiallyperpendicular to the coupling element and extends from a location on thecoupling element towards the user's head, wherein the coupling elementinterfaces with an eyewear frame such that the frame is customized tothe user's head.
 11. The system of claim 10, wherein the controller isfurther configured to: detect, from the anthropometric data, features ofthe user; and generate, based on the features of the user, the 3Dgeometry of the portion of the user's head.
 12. The system of claim 11,wherein the features of the user include at least one of a pinna of anear of the user, a distance of the user's ear from an eye of the user;and a size of the user's ear.
 13. The system of claim 10, whereingenerating the 3D geometry of the portion of the user's head comprises:determining features describing the anthropometric data; identifying keypoints and detected edges describing the portion of the user's headusing a machine learning algorithm and the features; and compiling thekey points and detected edges to form the 3D geometry of the portion ofthe user's head.
 14. The system of claim 10, wherein the designparameters include a length of the coupling element.
 15. The system ofclaim 10, wherein the design parameters for the coupling element areprovided to a manufacturer of the eyewear frame.
 16. The system of claim10, wherein the anthropometric data includes measurements of the portionof the user's head, and the measurements are used to generate the 3Dgeometry of the portion of the user's head.
 17. The system of claim 10,wherein the anthropometric data is determined from a video of the user,the video captured by the imaging device.
 18. A non-transitory computerreadable storage medium comprising computer executable code that whenexecuted by one or more processors causes the one or more processors toperform operations comprising: generating a three-dimensional (3D)geometry of a portion of a head of a user based in part onanthropometric data; and determining design parameters for a couplingelement based in part on the 3D geometry of the portion of the user'shead, the coupling element configured to couple to a temple, thecoupling element including a customized end of the temple that includesa temple tip and a shape of the coupling element is based in part on thedesign parameters and the design parameters include a first rotation ofthe temple tip towards the user's head and a second rotation of thetemple tip around an ear of the user, wherein the second rotation isabout an axis that is substantially perpendicular to the couplingelement and extends from a location on the coupling element towards theuser's head, wherein the coupling element interfaces with an eyewearframe such that the frame is customized to the user's head.
 19. Thenon-transitory computer readable storage medium of claim 18, the one ormore processors to perform operations further comprising: detecting,from the anthropometric data, features of the user; and generating,based on the features of the user, the 3D geometry of the portion of theuser's head.